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1. INTRODUCTION 


A. BACKGROUND 

Over the years, considerable research has been devoted to the development 
of Spectrometric Oil Analysis (SOA). This is a diagnostic maintenance tool 
used to maximize personnel safety and minimize cost of material readiness by 
monitoring the type and concentration of wear metals in lubricating fluid 
samples. The presence of unusual concentrations of an element in the fluid 
sample may indicate abnormal wear of the equipment. Once abnormal wear is 
verified, the equipment may be repaired or removed from service before a 
major failure occurs. SOA is widely used in the military services to monitor 
airplane engines, battleships, and military vehicles, etc. 

The basic principle of SOA is that when atomic structures of the metallic 
elements are sufficiently energized, they will emit light of characteristic 
wavelengths. These wavelengths are always identical for an individual element 
and no two elements will emit and absorb the same wavelength of light at the 
same intensities. Two kinds of measuring instruments are used in SOA; 
Atomic Absorption (AA) spectrometers and Atomic Emission (AE) 
spectrometers. 

Oil analysis by AE spectrometers is accomplished by subjecting the sample 
to a high voltage spark which energizes the atomic structure of the metallic 
elements, causing the emission of light. This light is focused into the optical 
path of the spectrometer, separated according to wavelengths, converted to 
electrical energy and integrated, giving a number referred to as the parts per 


million (ppm) concentration for the element. 
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Atomic absorption spectrometers operate on a different principle. With 
these instruments, the sample is aspirated into a flame and vaporized. The 
atomic structure of the elements present becomes sufficiently energized by the 
high temperature of the flame to absorb light energy. Light energy having the 
same wavelength cf the element being analyzed is radiated through the flame 
during this excitation and is partially absorbed in the flame. The resultant 
light is converted to electrical energy and integrated, again producing a number 
called the ppm concentration for the given element. 


The Joint Oil Analysis Program (JOAP) was established in 1976 for the 


purpose of developing a standardized, mutually beneficial program for all 


branches of the Department Of Defense (DOD). This program was expected to 
standardize the usage of SOA for all services, eliminating possible redundancies 
and inefficiencies. JOAP, in turn, was to institute methods to monitor both 
internal consistency of repeated readings by the same instrument, as well as 
consistency from one instrument to another, for all DOD laboratories. In 
support of this program the Joint Oil Analysis Program Technical Support 
Center (JOAP—-TSC) uses a monthly interlaboratory correlation program to 
ensure that spectrometers serving DOD remain calibrated and standardized. 
To accomplish this, JOAP—TSC sends out two "synthesized" oil samples and 
two "used" oil samples each month to approximately 200 atomic emission 
laboratories and 40 atomic absorption laboratories for analysis. The 
"synthesized" oil samples are made from regular service-grade oil, having 
soluble metallic contaminants added to set desired concentrations; the 
concentrations used are varied from month to month. The "used" oil samples 


are meant to be actual used—engine oil samples; however, due to the general 





difficulty in obtaining real used—engine oils, especially ones with controllable 
contaminant levels from month to month, these "used" oil samples are 
generally made up just like the synthesized samples, and typically contain very 
little, if any, real used—oil. Each instrument in the program analyzes these 
same four samples and the results are sent back to JOAP—TSC. This group 
then compiles the submitted data and issues a monthly report which gives 
summary descriptions across all laboratories (for both AA and AE 
instruments), as well as individual laboratory readings for the elements used, 
and accuracy and repeatability scores for laboratories. 

Most of the laboratories use atomic emission spectrometers, but a few Air 
Force laboratories perform oil analysis on atomic absorption spectrometers. 
Because of the differences in the operating principles of the two types of 
spectrometers, the concentration readings obtained from the two instruments 
tend to be different, when used to analyze the same oil sample. Some Air 
Force laboratories have both types of instrument; in these cases the AE 
instrument, which is large and bulky, is generally employed for all analyses at 
the home base. When a squadron of aircraft is deployed to a remote location, 
an AA instrument, which is much more portable than AE, is taken along for 
required oil analyses during deployment. This leads to the situation in which 
an oil sample from a given engine is analyzed on an AE instrument and the 
next one (or several) are analyzed on an AA instrument. In addition to this 
deployment situation, the AA instrument may occasionally be used at home 
‘ase as a back up when the AE instrument is out of service. Thus it is of 
practical interest to establish a method of converting concentration readings 


from one instrument to the other, especially for real used—engine oil samples. 


In 1975, the Naval Weapons Engineering Support Activity (NAVWESA), 
Washington, D.C., demonstrated the feasibility of using statistical regression 
techniques to establish a conversion formula for AE to AA readings. Lynch 
and Short [Ref. 1] used limited data from the interlaboratory correlation 
program to demonstrate this technique. They also recommended a more 
extensive study to establish this conversion formula. Culler (Ref. 2] also 
studied this problem in 1975 at the Southwest Research Institute, and 
recommended an additional conversion formula. In 1982, Jayachandran and 
Larson [Ref. 3] showed the possibility of estimating a conversion formula by 
using a simple regression analysis of the mean values of interlaboratory 
correlation data for the two instruments. Their results show that the fitted 
straight lines from regression analysis provide accurate representations for the 
relationship between AA and AE readings for these correlation samples. In 
addition, they provided a conversion table with estimated parameters. In 1986, 
they (Ref. 4] reported a more detailed study to establish the relationship 
between the readings from an AA _ spectrometer and those for an AE 
spectrometer with newer data sets from the same source. In this study, it was 
shown that the correlation coefficients between mean values of AA readings and 
AE readings are above 0.99 except for one element (molybdenum for used oil 
samples). However, there were no significant changes noted from the previous 


study. 


B. SCOPE OF THE THESIS 
The reports mentioned earlier use only correlation data in deriving the 


relationship between AA and AE concentration readings. These oil samples are 





man—made and typically do not contain actual used—oil in spite of the labels 


employed. The concentrations of the correlation program samples are 
controlled by the addition of soluble metallic concentrates to oil samples. Any 
procedure linking the readings of the two instruments might thus be expected 
to work well for oil samples whose metallic contaminations are totally in 
solution. 

Actual used—engine oil may, of course, contain tiny metallic particles in 
suspension. If the oil sample is removed from the engine while the oil is still 
hot, as is recommended, it is likely that tiny suspended particles will be 
included in the sample submitted for analysis. It then becomes important to 
see if any estimated relationships between AE and AA readings, determined 
from correlation samples with contaminants generally in solution, prove usable 
for real used—oil samples. This thesis will investigate this point indirectly, by 
employing actual operating engine oil analysis records reported in Fiscal Year 
(FY) 1988. 

The approach to be employed is the following: 

(1) Correlation program data will be used to get the "best fitting" 
relation between the AA and AE instruments. This is accomplished 
by using the trimmed means, for both AA and AE instruments, for 
36 months in the period from March 1980 through March 1988 (this 
data is essentially the same as that employed in Jayachandran and 
Larson's studies, augmented by a few months in 1987 and 1988) for 
both synthesized and used—-oil samples. All of these samples were 
analyzed on both types of instrument; the trimmed means (middle 


60%) for both instrument types are used. Since both types of 








trimmed means are random variables, orthogonal regression [Ref. 5] is 


employed to estimate the relationship, as opposed to standard least 
squares employed in Jayachandran and Larson's studies. This 
approach has the advantage of treating AA and AE symmetrically. 
The same line is found regardless of which instrument's values are 
called dependent and which is independent. 
The Air Force has supplied FY88 data on Air Force engines as 
reported to the B003 data base at Kelly Air Force base, Texas. This 
data contains all reported oil analyses for all Air Force engines for 
this year, for all spectrometers employed. A search of this data base 
has isolated six different type equipment codes for engines, of 3 
different types (turbo—jet, turbo—fan, turbo—prop), each of which have 
a fairly large number of readings from AE and from AA 
instruments. For any given element, say iron (Fe), one can then 
examine the distribution of AE readings and the distribution of AA 
readings (for each type equipment code). Using the linear relation 
determined in (1) from the correlation data, it then is possible to 
transform this used—oil AA distribution (from the B003 data base) 
accordingly; this transformed AA distribution can then be compared 
with the actual used—oil AE distribution observed. If the relation 
determined from the correlation samples in (1) is valid for used—oil 
readings, one would expect this transformed AA distribution to be 
very similar to the observed AE distribution. 

Chapter II discusses the orthogonal regression procedure and applies it to 


the correlation data; to get a better fit, some spline regressions are also 











employed there. Chapter III presents the used—oil distributions derived from 
the B003 data base. Chapter IV discusses the transformation of the used—oil 
distributions for AA, employing the equations from Chapter II, and presents 


several comparisons. Chapter V summarizes the conclusions. 














II. CORRELATION PROGRAM DATA AND ORTHOGONAL REGRESSION 


A. GENERAL 

Both AA and AE spectrometers are employed in the DOD Joint Oil 
Analysis Program. The JOAP-—TSC correlation program requires all 
participating laboratories to analyze the same four samples (two used-oil, two 
synthesized—oil) each month. This type of data has been employed to explore 
the relationship between the readings produced by the two types of instruments 
[Ref. 3, 4, 6]; the readings are highly correlated in general, as noted in these 
reports. 

It is well known that the simple linear regression model generally produces 
two different lines, depending on which of the two variables is called 
"dependent" and which is called "independent". That is, if AA readings are 
regressed on AF readings, the estimated line is not the same as that produced 
by regressing AE on AA. This in turn implies that conflicting results could 
occur in trying to investigate the accuracy of such estimated relationships when 
employed with actual used—engine oils. To circumvent this problem, this thesis 
employs orthogonal regression procedures. 

The data available consists of 64 of the 68 pairs of trimmed means used 
by Jayachandran and Larson, augmented by 8 later pairs of trimmed means, 
giving 72 data points in total. These correlation samples were analyzed for 
contamination levels of 10 different elements (Fe, Ag, Al, Cr, Cu, Mg, Si, Ti, 


Mo, and Ni). Since the used—engine oj] data to be discussed in the following 


chapters includes only elements Fe, Ag, Al, Cr, Cu, and Mg, these are the 








only ones which are discussed in this thesis. Of these, iron (Fe) is by far the 
most important in terms of applications in JOAP, so the discussion here will 
explicitly discuss this single element. The same general conclusions are 


appropriate for all the others. 


B. SUMMARY OF CORRELATION DATA 

Appendix A presents the correlation data used in this thesis; given there 
are the trimmed means of AA and AE readings from all laboratories 
participating in the interlaboratory correlation program for the specified 
months. It can be seen from the used—oil sample tables that the mean values 
of the AA readings are generally lower than the mean values measured by AE 
instruments, while the synthesized—oil mean values are roughly the same for 
both instrument types. 

Figure 1 displays the scatter plots of synthesized—oil and used—vil 
correlation data for Fe in two different ways. The top plots present the data 
in the (AA, AE) plane while the bottom plots use the (AA, AE/AA) plane. 
The scatter plots of the other metallic elements are presented in Appendix B. 
Note that the synthesized—oil samples are generally well behaved, with almost 
perfect linearity exhibited between the AA and AE trimmed means. The 72 
samples are fairly uniformly spread over the ranges covered for both 
instruments, and the readings for both instruments are roughly the same 
magnitude, with the AE/AA ratios hovering close to 1. 

The used—oil trimmed means do not adhere to strict linearity as well, nor 
are they as uniformly distributed over the ranges covered; the great majority of 


the 72 samples are concentrated on the low end of the scales for both 
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Figure 1. Scatter plots of used and synthesized correlation data and 
plots of ratio (AE/AA) vs AA 


instruments, with the AA means typically being smaller than the AE means. 


Notice that the AE/AA ratios for low AA values are quite different from those 


with high AA values, and that they all exceed 1. This different behavior may 
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be attributed to the presence of actual used—oil in some of these samples (most 
likely those with small AA readings), but unfortunately no records are 
available describing the frequency of use of real used—oil in the correlation 
program. 

Because of this nonlinearity of used—oil samples, two different approaches 
will be tried in deriving an AE—AA relationship which might be useful for real 
used—oil samples. The first of these is a single orthogonal—regression straight 


line; the second approach employs a spline with one knot. 


C. ORTHOGONAL REGRESSION ANALYSIS 

The usual least squares approach could be employed in estimating a linear 
relationship between AE and AA means (indeed, this is the approach used in 
(Ref. 3, 4]); as has been mentioned, this procedure will typically (certainly for 
the current data) lead to two different regression lines, depending on which 
instrument is chosen to be the "dependent" variable. Orthogonal regression 
lines minimize the "perpendicular" distances between the observed data values 
and resulting lines; the same line is found regardless of which of the two 
instruments' readings is chosen to be the dependent variable. This 
methodology can be paraphrased as follows. 

1. Single Straight Line 

Granted one has n_ data pairs (xi, yi), first let us "center" the 


coordinate system at the means of the two variables by defining 


Xj = xj-*% 
(2.1) 


Yi = yi-y 





Figure 2. Orthogonal regression analysis (single line) 


where x = 15x, y= oNYi. Next, perform a rotation of the coordinate axes 


through an angle a (to be determined) by letting 


uj = X;cosa+Yjsina 
(2.2) 


—X jsina+ Y ;cosa@ 


= 
il 


as pictured in Figure 2. With the original (xj, yi) values lying roughly on a 


straight line with positive slope, this transformation then results in the u—axis 
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passing through the body of the data (with 0<a< 5 ) and the vi values 
represent the perpendicular distances from the original points to the u—axis. 


The angle a thus should be chosen to minimize 


= 3 (-Xisina+¥ cosa)? (2.3) 
hs 


and the resulting minimizing angle a then is defined by equation (2.4). 


; (Syy Sux) +4 (Syy~Sex)2+4Sxy? 
Ca ee o 
Sxy 


where Sxx = E(xj—-%)?, Sxy = U(xi-%)(yj-y), and Syy = Uyi-y)?. 
The tangent of this angle a is the slope of the orthogonal regression line in 


the original coordinate system for (xj, yi); thus the orthogonal regression line 


in the original coordinate system is given by 
y = y—xtana+xtana@ 
= a+ bx (2.5) 


where @ = y-Xtana, 6 = tana. 




















Applying this orthogonal regression methodology to the correlation 
data gives the lines plotted in Figure 3; the slopes and and y—intercept are 


given in Table 1, along with the resulting residual sums of squares (Lv;?). 


Table 1. ESTIMATED PARAMETERS FOR Fe 


synthesized-oil “1.314 1.051 112.515 
used-oil 4.627 1.151 456.820 


The synthesized—oil data is quite well fit by the orthogonal regression line, as 








certainly could have been anticipated from Figure 1. The used—oil data is not 
as well represented by the orthogonal regression line, because of the 
non—linearity evident in Figure 1. This same type of problem also occurs with 
aluminum (Al) and magnesium (Mg). 

The great majority of actual used—oil readings are on the low end of 
the scales, mostly 20 ppm or less for both instruments. To test the 
effectiveness of a conversion formula between AA and AE it is thus important 
to employ an estimated equation which fits the low ppm values well. One 
way to accomplish this is to use linear splines, connected straight line 
segments; such broken line segments remain continuous, giving a useful way of 


comparing actual AA and AE used-oil readings. 
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Figure 3. Regression plots of Fe synthesized data and Fe used data 
(single line) 
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2. Two Line Regression 


To derive a useful spline equation, still employing orthogonal 
regression, the following procedure is followed. Recall the earlier comment that 
the great majority of actual used—oil readings are on the low end of the ppm 
scale, so it is most important to get a good fit for low readings. Let p 
represent the (fixed) knot location on the AA scale. Then the data to the left 
of p, those pairs with AA reading no larger than p, are used to determine an 


orthogonal regression line 
y=at & 


as already described. This line passes through the point y = at+bp at the 
knot location p. 

To fit a second line to the data to the right of the knot, those pairs 
with AA reading larger than p, a new coordinate system is employed with 
origin at (p, a+bp) (in the original system), using only the data to the right 


of the knot. The slope parameter for this line is given by 


- (Un-Un)-+4 ( Un—Un)24+-4U mn 
tang = (2.6) 
2U nn 


where Ug=2mj?, Ug=knj2, Unn=2myni, my=xi-p, and nj=yj-(atbp). A 
measure of goodness of fit of the resulting spline is given by adding the Lv;2 
values for the left and the right lines. 

The above procedure was implemented by letting p (the knot 


location) equal each of the 66 middle AA observed values in turn, observing 


16 





the goodness of fit value for each location. The knot is then located at the 


AA value with the smallest goodness of fit value. This is summarized below. 


(1) 


Sort data. AA readings are employed as the independent variable; 
therefore, after sorting AA readings, AE readings are sorted for tied 
AA readings. 

Choose knot location, and divide the ordered data into two parts 
without overlap, then transform the x—axis from 0 to the given knot 
p. The given knot is fixed at one of the data points. 

Estimate the orthogonal regression parameters for the first segment 
with equations (2.4) and (2.5). 

Move the origin to x=p, y=atbp. Then estimate the slope 
parameter for the second segment with equation (2.6). 

Compute the sum of squares for both segments and sum them to get 
goodness of fit. 

Do the above procedures for all possible knots, then compare the 
goodness of fit for all knots and find the best knot. 

Re—transform the slope and intercept parameters for the best knot to 


the original coordinate system. 


Using the Fe used—oil data set displayed earlier, the spline orthogonal 


regression routine locates the best knot at p=11.3 (AA reading), giving a sum 


of squares of 261.615 compared with 456.820 for the single line. The 


parameters defining these lines are given in Table 2 while Table 3 gives the 


corresponding results for the Fe synthesized—oil values. It is interesting that 
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Table 2. ESTIMATED PARAMETERS FOR Fe USED-OIL 


Single line 
4.627 1.151 456.820 


Table 3. ESTIMATED PARAMETERS FOR Fe SYNTHESIZED OIL 
single line 


“1.314 1.051 112.515 
two lines 
1.014 1.341 61.520 






















left slope right slope 





the percent change in the sums of squares is about the same for both types of 
samples. These spline regressions for the synthesized and used—oil samples are 
plotted in Figure 4. Notice that the knot location for the synthesized—oil 


samples is at p=79.7, much higher than for the used—oil samples. 
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: Figure 4. Regression plots of Fe synthesized data and Fe used data 
(spline) 





i. REAL USED—OIL DATA 


A. GENERAL 

The correlation program data already discussed contains average readings 
made by both AA and AE spectrometers, on exactly the same prepared 
samples, half of which are labeled synthesized—oil and half of which are 
labelled used—oil. These samples allow direct investigation of possible 
relationships between the readings produced by the two instrument types. 
Unfortunately there is no comparable source providing readings from oth 
instruments for samples of oil drawn from operating aircraft (real used—vil); 
thus it is not possible to directly check the reliability of the AA—AE 
relationships derived from the correlation program samples. 

JOAP maintains a data repository for oil analysis records (called the B003 
data bank) at Kelly Air Force Base, Texas. All DOD oil analysis laboratories 
are required to periodically submit all oil analyses records to this data bank. 
These oil analysis records identify the laboratory and instrument type 
employed, the particular equipment from which the sample was taken, 
contaminant readings observed (rounded to the nearest ppm), the laboratory 
recommendation made, and a number of other items. The Air Force oil 
analysis program management has provided a data tape containing all Air 
Force oil analysis records submitted to B003 in FY88. A search of these tapes 
has located several different Type Equipment Codes (TEC's) which have fairly 
sizable numbers of analyses performed on both AE and AA instruments during 


this period. Although none of these oil samples were analyzed on both 
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instrument types, it is possible, for a specific TEC, to derive the distribution 
of readings for a given contaminant (say Fe) produced by the AE instruments 
and to derive this same distribution produced by the AA instruments (for this 
same TEC). Making the assumption that different engines of the same type 
should exhibit very similar distributions of contaminant readings, the B003 
data can be employed to get AE and AA distributions, for real operating 
engines; indeed, it then is possible to use the relations derived from the 
correlation program samples to transform the AA _ distribution into an 
"expected" AE distribution (or vice versa). The "expected" AE distribution 
can then be compared with the actual AE distribution, to examine the validity 
of the correlation sample relationship for "real" used—oil samples. This 


approach is fcllowed in this thesis. 


B. DESCRIPTION OF REAL USED-OIL DATA 

In the thesis, several different types of equipment codes are used; DFKA 
and EPJA for turbo—fan jet engines, BSQA and BSPA for turbo—jet engines, 
LLDA and LLLA for turbo—prop engines. When these data tapes were read 
by the statistical software package SAS [Ref. 7] on an IBM 3033AP 
mainframe, some filters were applied to the data before summarization. These 
include deleting those records where the reason for the sample was T, K, M, 
P, or X : Test Cell, Prior to Maintenance—-Removal, Post Maintenance Check, 
Physical Test and Initial Sample. 

To ensure the use of records from actual working aircraft, only those serial 
numbers with at least 40 records for the year were included, for DFKA, EPJA, 
BSQA and BSPA. For LLDA and LLLA, because of the smaller number of 
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records available, all serial numbers with at least 20 records for the year were 
employed. The SAS outputs for TEC DFKA are presented in Table 5 and 
Table 6. The data submitted to B003 is not checked for validity and many 
data transcription errors can be expected; all of the readings of 100 or more 
are undoubtedly erroneous, as are some of the smaller values. To clean up 
these data errors a simple rule was employed: keep only the data up to the 
contaminant level where the SAS computed Cumulative Percentage Rate (CPR) 
first reaches 100.0. For example, the CPR value first reaches 100.0 at 15 ppm 
in Table 5. Therefore, the data analyzed are those less than or equal to 15 
ppm for this TEC, for Fe. Table 4 presents the original sample sizes for the 
six TEC's as produced by SAS, and the resulting numbers of records kept after 


using this rule. 


Table 4. NUMBERS OF RECORDS KEPT FOR Fe 


TOTAL on TAPE NUMBER KEPT 
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Table 5. SAS OUTPUT FOR DFKA AE READINGS (Fe) 


CUMULATIVE CUMULATIVE 
FE FREQUENCY PERCENT FREQUENCY PERCENT 
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Table 6. SAS OUTPUT FOR DFKA AA READINGS (Fe) 


CUMULATIVE CUMULATIVE 
FREQUENCY PERCENT FREQUENCY PERCENT 





These cumulative percent values can be interpreted as values for a 
Cumulative Density Function (CDF) for a random variable. Thus, the values 
given in Table 5 that were kept after eliminating spurious records can be 
graphed as in Figure 5. The corresponding records for Fe, TEC DFKA, 
produced by the AA instruments are given in Table 6 and also graphed in 
Figure 5. (Note the two T scales are different in this figure.) 

The phenomenon measured by either type of spectrometer is ideally 
continuous; both instruments produce readings to 0.1 ppm but are reported to 
B003 as rounded values to the nearest ppm. Thus the values reported as 0 
ppm correspond to readings between 0 and 0.5 ppm, those reported as 1 ppm 
correspond to readings between 0.5 and 1.5 ppm, etc. In recognizing this fact, 
it is useful to realize that the step functions given in Figure 5 actually are 
estimating continuous CDF's at particular points (and no estimate is available 
in between these points). Thus the CDF reading of 0.242 for 0 ppm for Fe, 
DFKA, for the AE instrument, can be pictured as the height of this CDF at 
0.5 ppm (the end of the interval (0, 0.5)); the readings at the other integers 


(1, 2, 3, -+++- ) estimate the CDF value at the same integers plus 0.5. These 












PLOT of STEP FUNCTION 
(OFKA AE READINGS, Fe) 













PLOT of STEP FUNCTION 
(OFKA AA READINGS, Fe) 








Figure 5. Plots of step function for DFKA Fe 








points can then be connected by straight lines to better estimate the 
underlying continuous CDF's. The resulting "continuous" estimated CDF's are 
plotted in Figure 6 for DFKA, Fe. 

It is obvious from this figure that the CDF's resulting from actual 
used—engine oil values (for TEC DFKA) are not identical. There are many 
ways that the AA distribution (or certain aspects of this distribution) could be 
transformed through the relationship established from the interlaboratory 


correlation program data, to compare with the counterpart of the actual AE 





values. Some comparisons of this type are discussed in the following section. 
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Figure 6. Plots of estimated CDF's for DFKA Fe 
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IV. COMPARISONS FOR USED—OIL DISTRIBUTIONS 


A. GENERAL 

Recall that we are comparing readings made on AE instruments versus 
those made on AA instruments as reported to the B003 data base; none of 
these oil samples were analyzed on both instruments. So long as operating 
engines (of the same TEC) are involved, it seems reasonable that one should 
be able to relate the AE distribution of readings produced to the AA 
distribution of readings produced. This basic idea is employed in what follows. 
In addition, the distributions of the other metallic elements except Fe are 
typically not widely enough dispersed to see relationships between the readings 


of both instruments. Thus just Fe is employed in these comparisons. 


B. COMPARISONS 

As seen in Chapter II, the synthesized—oil samples from the correlation 
program adhere to linearity fairly well, while the used—oil samples are not so 
well—behaved. Orthogonal regressions over the whole range of the correlation 
data were derived, for both types of sample, and single-knot splines were also 
fit to the data. Table 7 gives the number of data values from B003 data base 
above the best knot location for the 6 TEC's, for all elements. The symbol 
'—' in this table means that these specified elements are not monitored for the 
given TEC. As can be seen, very little B003 data lies to the right of the 


knot location, meaning the equation to the left of the knot is applicable almost 
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Table 7. | NUMBER OF DATA ABOVE KNOT (AE/AA) 





everywhere for all cases. In the following, only the spline relationships are 
employed to compare the AA used—oil values with the AE used—oil values 
from BO003. 
1. Mean and Variance 

Most statistical techniques employ simple descriptors of the mean and 
variance of a set of data. Accordingly, one way of using the actual used-il 
readings to see the value of correlation—sample regressions is given by 
evaluating the mean and variance of the actual AE readings, getting the mean 
and variance of the actual AA readings and then transforming the AA values 
to compare with their AE counterparts (or vice versa). As is well known, in 


the case of an increasing spline function, where 


Y = a+bX if X<p 
(3.1) 


< 
I! 


a+bp+cxX if X>p 
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ly = (a+ buy ¢5)P(X<p) + (a+bp+ cy, »)P(X>p) (3.2) 


Explicit formulas relating the variances are quite complicated and are not 
given. For DFKA, element Fe, the AE mean and variance are 1.3947 and 
1.6306, and the AA mean and variance are 1.1463 and 0.3024 The orthogonal 
regression coefficients for this TEC for both types of sample, are given in 
Table 8; the resulting transformed AA means and variances are given in Table 


9. 


Table 8. SPLINE REGRESSION COEFFICIENTS FOR Fe, DFKA 


79.7 


synthesized-oil 
used-oil 11.3 


Table 9. EXPECTED MEAN AND VARIANCE OF AE READINGS 
FROM AA TRANSFORMATIONS, DFKA 


[perenstere fron | mean | veriance 
EXPECTED synthesized-oil -9111 - 3106 
VALUES 


ORIGINAL 





As can be seen from Table 9, the synthesized—oil transformed AA inean is 
smaller than the actual AE mean, while the used—oil transformed mean is 
larger (and closer). Both of the transformations yield expected variances which 
underestimate the actual AE variance, but again the used—oil value is closer. 
This underestimation of the variance is driven by the small variance exhibited 
by the actual AA distribution. Mean and variance tables for the other TEC's 
are presented in Appendix D to H. If one formally tests the hypothesis of 


equality of either means or variance (expected AE versus actual AE), these 


differences are highly significant, because of the large sample sizes involved. 


2. Cumulative Density Function (CDF) 


Rather than compare simply means and variances, it is quite 
straightforward to use the spline regression results discussed in Chapter II to 
transform the observed B003 AA CDF to the expected AE CDF. This 
expected AE CDF can then be compared to the actual observed B003 AE 
CDF, for the same TEC and element. In fact either of the two spline 
regressions derived in Chapter II (from synthesized—oil and from used-oil 
correlation samples) can be used to get an expected AE CDF for the 
comparison. Both expected AE CDF's have been compared to the observed 
AE CDF. For the spline function discussed earlier, the CDF relationship is 


given by 














For TEC DFKA, element Fe, the observed B003 used—oil CDF for 
AA readings is given in Table 10 and the observed used—oil CDF for AE 
readings is given in Table 11; the synthesized—oil and used—oil spline functions 
are in Table 8. Transforming Table 10 (AA) using these spline functions gives 
the two CDF's in Table 12, to compare with the observed used—oil CDF. 


Graphs of all three are given in Figure 7. 


Table 10. TABLE OF AA READINGS FOR TEC DFKA, Fe 


CUMULATIVE 
AA FREQUENCY DENSITY FREQUENCY CDF value 





Table 11. TABLE OF AE READINGS FOR TEC DFKA, Fe 


CUMULATIVE 
FREQUENCY DENSITY FREQUENCY CDF value 
0 


0 -0000 
30511 2422 
86065 - 6832 

109675 - 8706 
118296 -9390 
122009 -9685 
123748 9823 
124790 -9906 
125326 -9948 
125631 -9973 
125782 -9985 
125893 -9993 
125944 -9997 
125961 -9999 
125968 -9999 
125973 1.0000 
125976 1.0000 


-0 

-5 
1.5 
2.5 
3.5 
4.5 
5.5 
6.5 
7.5 
8.5 
9.5 
0.5 
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Table 12. SYNTHESIZED-OIL AND USED-OIL TRANSFORMATION, 
DFKA, Fe 


transformed scale to AE scale 


CDF 
value synthesized-oil used-oil 
transformation transformation 


max diff. - 2085 ~1732 
(location) ( 1.27) ( 1.50) 


Because both the synthesized—oil and used—oil regressions have negative 
y—intercepts, the transformed AA 0 point is negative; this automatically leads 
to possibly large discrepancies for low ppm values. As can be seen from 
Figure 7, the used—oil transformation tracks the observed AE distribution much 
better than the synthesized—oil transformation. The plots and the results of 
transformation for the other TEC's are presented in Appendix D to H. 
Kolmogorov—Smirnov type statistics [Ref. 8] are available for comparing two 
sample CDF's; again because of the very large sample sizes (and in part 
because of rounding to integer values) both transformed CDF's differ very 
significantly from the observed AE CDF. This phenomenon remains true for 


all elements and all TEC's examined. 








PLOT of CDF (DFKA Fe) 





Figure 7. Plots of original AE CDF and expected CDF's from AA CDF 











V. CONCLUSIONS 


The purpose of this investigation was to check the validity of correlation 
program sample relationships between AA and AE readings when employed 
with real used—oil samples. Since no data bank of used—oil readings, from 
both instruments, is available for this purpose, an indirect method was 
employed utilizing records from the B003 data bank. 

The used—oil sample relationships uniformly perform better than do the 
synthesized—oil relationships; this was not expected because these used-oil 
correlation samples frequently contain no real used—oil. Perhaps the particular 
months of correlation samples employed here are unusual in that regard; there 
appears to be no definitive way of determining this. 

While the used—oil sample relationships perform better, the results 
produced leave much to be desired. Any common statistical test comparing 
the actual AE values to the expected values gotten by transforming the AA 
values shows them to be extremely different. This is in part due to the large 
sample sizes available from the B003 data bank. It is also wise to keep in 
mind the fact that none of these B003 samples were analyzed on both 
instruments. Perhaps the underlying assumption that the actual contamination 
levels, for Fe, say, should be the same, for those engines whose samples are 
sent to AE laboratories as it is for those sent to AA laboratories, is not 
satisfied. 

There are other reasons which may contribute to lack of performance for 


simple AA—AE relationships. As has been mentioned, the AA instrument uses 





a flame to energize the oil sample, while the AE instrument employs a spark. 
The level of excitation accomplished by these two methods is undoubtedly 
different, which in turn could affect the readings produced, even though the 
same oil sample is employed. The fact that one instrument bases its 
measurement on light emitted, while the other uses light absorbed, may also 
cause difficulties in relating the two. 

Probably the largest source of difficulty in relating AA and AE readings, 
for real used—oil, is the question of particle size. As an operating engine wears 
it may very well place tiny particles of metal into the oil; for small enough 
particles, many of these may in fact remain in suspension in the oil. These 
particles in suspension are most likely of many different sizes; indeed it is easy 
to conceive of a particle size distribution for those in suspension. It is quite 
likely that the two instruments do not "see" identical windows of these particle 
size distributions. This is caused in part by the different methods of exciting 
the sample for analysis, and also by the different methods used to introduce 
the sample to the energy source. The AA instruments aspirate the oil into the 
source, while the AE instruments fire a spark from a stationary pencil 
electrode to the top of a rotating cisk electrode, which relies essentially on oil 
viscosity to carry particles to the energy source. 

The most reliable way to convert between AA and AE readings, for real 
used—oil, is necessarily based on analyzing the same samples on_ both 
instruments. The used—oil samples employed should contain particle-size 
distributions typical of those to occur in the engines to be monitored, and may 
well differ from one TEC from another. This type of study would be fairly 
expensive to undertake, but may be necessary to get well—performing 


relationships between the readings of the two types of instruments. 
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APPENDIX A. SUMMARY OF CORRELATION DATA 
Table 13. Fe SYNTHESIZED-—OIL SAMPLES 


ABSORPTION EMISSION 


8. 
4 


9 
1981 JAN 34.2 
FEB 79.7 


1987 DEC 


1988 JAN 








Table 14. Fe USED—OIL SAMPLES 


ABSORPTION EMISSION 
ce + [ous | ce» [sa 


6 
3 
1 
3 
1 
7 
2 
2 


ONnNWUWHO~)D 
a 

NN OF WR Ws) 

ee «© ¢ e@# @® @ @ 

e @# @# @ &®© &® @ @ 

COURDOAN 
o 

WE UNNWAN 

ee ee @# e# © @® je @ 

wowuuNnr~ & & OW 


ONDKFPNNUONN 
F oO 
&UUN ND Ww OF 


1987 DEC 


1988 JAN 
FEB 
MAR 








Table 15. Ag SYNTHESIZED—OIL SAMPLES 


ABSORPTION EMISSION 


3.8 3.6 
1981 JAN 33.9 31.2 
FEB 44.3 38.7 


1987 DEC 


1988 JAN 
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Table 16. Ag USED—OIL SAMPLES 


ABSORPTION EMISSION 


3 
2 


1 1.1 
6.6 6.2 





1987 DEC 


1988 JAN 
FEB 
MAR 
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Table 17. Al SYNTHESIZED—OIL SAMPLES 


ABSORPTION EMISSION 


1988 JAN 
es 
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Table 18. Al USED—OIL SAMPLES 
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Table 19. Cr SYNTHESIZED—OIL SAMPLES 





ABSORPTION EMISSION 


1987 DEC 


1988 JAN 
FEB 
MAR 








Table 20. Cr USED—OIL SAMPLES 


ABSORPTION EMISSION 


1981 JAN 33. 
FEB 8. 


on 


}1987 DEC | DEC 


1988 JAN 
cae 





44 





Table 21. Cu SYNTHESIZED—OIL SAMPLES 


ABSORPTION EMISSION 


1988 JAN 
FEB 
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Cu USED—OIL SAMPLES 


ABSORPTION EMISSION 


Table 22. 
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Table 23. Mg SYNTHESIZED—OIL SAMPLES 


ABSORPTION EMISSION 


1988 JAN 
FEB 
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Table 24. Mg USED—OIL SAMPLES 


ABSORPTION EMISSION 

























5 

5 
6.1 6.4 11.6 12.6 
3.5 3.6 6.9 6.8 
12.6 11.4 27.7 24.8 
5.1 5.0 6.5 6.4 
3.3 3.3 6.4 6.4 
3.4 3.5 6.3 6.3 
9.3 8.9 20.0 19.1 
2.8 2.8 5.4 5.5 





1987 DEC 


1988 JAN Br 1.5 
FEB 31.2 
MAR 

























APPENDIX B. SCATTER PLOTS OF CORRELATION DATA ) 
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Figure 8. 





SCATTER PLOT of Ag SYNTHESIZED SAMPLE 
(CORRELATION DATA) 
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SCATTER PLOT of Ag USED SAMPLE 
(CORRELATION DATA) 
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Scatter plots of Ag synthesized and used-oil samples 
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SCATTER PLOT of Al SYNTHESIZED SAMPLE 
(CORRELATION DATA) 
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SCATTER PLOT of Al USED SAMPLE 
(CORRELATION DATA : SINGLE LINE) 
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Figure 9. Scatter plots of Al synthesized and used—oil samples 
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SCATTER PLOT of Cr SYNTHESIZED SAMPLE 
(CORRELATION DATA) 
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SCATTER PLOT of Cr USED SAMPLE 
(CORRELATION DATA) 


EMISSION 


ABSORPTION 





Figure 10. Scatter plots of Cr synthesized and used—oil samples 
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SCATTER PLOT of Cu SYNTHESIZED DATA 
(CORRELATION DATA) 
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Figure 11. Scatter plots of Cu synthesized and used—oil samples 











SCATTER PLOT of Mg SYNTHESIZED SAMPLE 
(CORRELATION DATA) 


EMISSION 


ae oe 


ABSORPTION 
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Figure 12. Scatter plots of Mg synthesized and used—oil samples 


53 





APPENDIX C. ESTIMATED PARAMETERS (CORRELATION DATA) 


Table 25. ESTIMATED PARAMETERS (SINGLE LINE) 


Pt a lal BE 
pot we eo wm [BE 
intercept| slope squares|intercept| slope quares 

“1. } n1.3a4 | | 2.052 | 051 112. | 412.515, | 4.627 | 627 1. | a.asa | } 456.820] 820 
fg | --070 [964 [ e7.oi8| ~.aeo_[ 2.07 | as.068 
jer | -208 [2.027 | a3e.aso| as? | a.ase | 22.206 
fou [a-eee [004 [ 202.779] “toe [ares [ e722 
fg [2-489 | 010 | as0.t62] 9.909 | 2.300 [reie.si6 


Table 26. | ESTIMATED PARAMETERS FOR SYNTHESIZED-OIL 
SAMPLES (SPLINE) 


best sum of 
knot squares 
Biaeee slope tieercepe slope a 


eg ee 
pal aes [een | aa [se [ane [seas 
ee] _-e0e | acer | ~7-eeo | nasy | ease | aa0.s25 
eof ers [aves | oave | ois | a9.00 | essnee 
na] 00 | a0ze | s.aco | 00s | v.70 | naocees 
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Table 27. | ESTIMATED PARAMETERS FOR USED—OIL SAMPLES 
=e 


| left line | line | right line | line 
It best sum of 
knot squares 

ee slope ineereape a rel 

Le eeerO 1.992 9.521 | 1.090 | 090 } 12.30 | 30 261. | 261.615 | 
a ives [| aan | ase | 720 [9.734 
= 71.555 1.511 1.826 1.230 12.00 23.033 
“1.516 1.878 5.701 1.494 18.80 82.611 
aero 1.707 27.855 1.047 41.70 692.184 








APPENDIX D. SUMMARY OF COMPARISON FOR TEC BSPA, Fe 


Table 28. EXPECTED MEAN AND VARIANCE OF AE READINGS 
FROM AA TRANSFORMATIONS, BSPA, Fe 


synthesized-oil 1.0847 .9738 


















EXPECTED 
VALUES 





ORIGINAL 
VALUES 





Table 29. TABLE OF AA READINGS FOR TEC BSPA, Fe 


CUMULATIVE 
AA FREQUENCY DENSITY FREQUENCY CDF value 


oo 8 @© @ 


ANaaannooao 


1 
2 
3 
4 
5 
6 
7 
8 
9 
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Table 30. TABLE OF AE READINGS FOR TEC BSPA, Fe 


CUMULATIVE 
FREQUENCY DENSITY FREQUENCY CDF value 


« © @# e¢* @ @ @ @® @ @ @ 
AON nnnan»a»nane 


9 
4 
4 
3 
3 
4 
8 
1 
1 
1 
1 
1 
6 
1 
1 
1 
1 
6 





oT 








PLOT of COF (BSPA Fe) 





Figure 13. Plots of original and expected AE CDF from AA CDF, BSPA 


Table 31. SYNTHESIZED—OIL AND USED—OIL TRANSFORMATION, 
BSPA, Fe 


transformed scale to AE scale 


CDF 
value synthesized-oil used-oil 
transformation transformation 


-O 
5 
1.5 
2.5 
3.5 
4.5 
5.5 
6.5 
7.5 
8.5 
9.5 





max diff. -5757 
(location) ( 1.27) 


58 








APPENDIX E. SUMMARY OF COMPARISON FOR TEC BSQA, Fe 


Table 32. EXPECTED MEAN AND VARIANCE OF AE READINGS 
FROM AA TRANSFORMATIONS, BSQA, Fe 


synthesized-oil 1.0941 - 5697 


AE 3.0861 4.2790 


Table 33. TABLE OF AA READINGS FOR TEC BSQA, Fe 


UMULATIVE 
AA FREQUENCY DENSITY FREQUENCY CDF value 



















EXPECTED 
VALUES 














ORIGINAL 
VALUES 


-0O 
5 
5 
5 
5 
5 
-5 
5 
5 
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Table 34. TABLE OF AE READINGS FOR TEC BSQA, Fe 


-0000 
-0119 
~1741 
- 4539 
- 6882 
-8317 
-9089 
-9489 
-9705 
-9809 
-9873 
-9914 
-9943 
-9962 
-9972 
-9978 
-9982 
-9984 
-9984 
-9985 
~9985 
-9988 
-9989 
-9991 
-9991 
-9993 
-9994 
-9995 
-9995 
-9996 
-9996 
-9997 
-9998 
-9998 
-9999 
1.0000 


OF O1 OT OF O1 OF OF OF OT OT OT © 


OVUONAU AWN bh 


os e@ @© © e@ © © @ @ © © 8 @ 


~ 


WPRPNNARP WN WEA SAIN OWNDND OO 
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PLOT of COF (BSQA Fe) 





Figure 14. Plots of original and expected AE CDF from AA CDF, BSQA 


Table 35. SYNTHESIZED—-OIL AND USED—OIL TRANSFORMATION, 
BSQA, Fe 


transformed scale to AE scale 


synthesized-oil used-oil 
transformation transformation 


- 0000 
-0499 
- 7303 
©9337 
-9803 
-9933 
-9983 
-9997 
1.0000 


anon oo oo 


1 
2 
3 
4 
5 
6 
7 
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APPENDIX F. SUMMARY OF COMPARISON FOR TEC EPJA, Fe 


Table 36. EXPECTED MEAN AND VARIANCE OF AE READINGS 
FROM AA TRANSFORMATIONS, EPJA, Fe 


synthesized-oil 2156 -1219 

















EXPECTED 
VALUES 


ORIGINAL 
VALUES 





Table 37. TABLE OF AA READINGS FOR TEC EPJA, Fe 





62 











Table 38. TABLE OF AE READINGS FOR TEC EPJA, Fe 


CUMULATIVE 
FREQUENCY DENSITY FREQUENCY CDF value 


-0000 
3241 
- 6933 
-8485 
-9229 
-9596 
-9770 
-9863 
-9924 
-9955 
-9975 
-9985 
-9993 
-9997 
-9998 
1.0000 



























AManna1awa4noae 






OVUBDNAUPWNE 

























PLOT of COF CEPJA Fe) 








Figure 15. Plots of original and expected AE CDF from AA CDF, EPJA 


Table 39. SYNTHESIZED—OIL AND USED—OIL TRANSFORMATION, 
EPJA, Fe 7 


transformed scale to AE scale 


synthesized-oil used-oil 
transformation transformation 
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APPENDIX G. SUMMARY OF COMPARISON FOR TEC LLDA, Fe 


Table 40. EXPECTED MEAN AND VARIANCE OF AE READINGS 
FROM AA TRANSFORMATIONS, LLDA, Fe 


EXPECTED synthesized-oil | 2.0350 1.7155 
VALUES 
used-oil 3.8227 6.6266 


AE 
ORIGINAL 


VALUES AA « 2552 1.6698 


Table 41. TABLE OF AA READINGS FOR TEC LLDA, Fe 


CUMULATIVE 
FREQUENCY DENSITY FREQUENCY CDF value 
0 0 










e 


OOanawnnawnino 


1 
2. 
3 
4 
5. 
6. 
7 
8 
9 
1 


°° e 


=) 





65 





Table 42. TABLE OF AE READINGS FOR TEC LLDA, Fe 


CUMULATIVE 
FREQUENCY DENSITY FREQUENCY CDF value 


- 0000 
-0582 
- 2003 
-3913 
-5577 
- 6828 
7677 
- 8343 
- 8926 
-9334 
-9576 
~9720 
-9789 
-9857 
-9898 
-9932 
-9959 
-9969 
-9985 
-9994 
~9997 
-9998 
1.0000 


NOnannnno ooo 


1 
2 
3 
4 
5 
6 
7 
8 
9 
0 
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PLOT of CDF (LLDA Fe) 
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Figure 16. Plots of original and expected AE CDF from AA CDF, LLDA 


Table 43. SYNTHESIZED—OIL AND USED—OIL TRANSFORMATION, 
LLDA, Fe 


transformed scale to AE scale 


CDF 
value synthesized-oil used-oil 
transformation transformation 


-0000 ~.251 ~.670 
- 0566 -256 326 
- 2583 1.270 2.318 
- 6630 2.283 4.310 
- 8573 3.297 6.302 
-9729 4.310 8.295 
- 9803 5.324 10.287 
-9865 6.337 12.279 
-9914 7.351 14.271 
-9951 8.365 16.263 
-9988 9.378 18.255 
1.0000 11.405 22.059 


-0O 
5 
5 
-5 
-5 
5 
5 
5 
5 
-5 
5 
5 


1 
2 
3 
4 
5 
6 
7 
8 
9 
1 
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APPENDIX H. SUMMARY OF COMPARISON FOR TEC LLLA, Fe 


Table 44. EXPECTED MEAN AND VARIANCE OF AE READINGS 
FROM AA TRANSFORMATIONS, LLLA, Fe 


synthesized-oil 1.8958 1.4929 


Table 45. TABLE OF AA READINGS FOR TEC LLIA, Fe 


UMULATIVE 
FREQUENCY DENSITY CREE OUEACT CDF value 


















EXPECTED 
VALUES 








ORIGINAL 
VALUES 





-0 
5 
1.5 
2.5 
3.5 
4.5 
5.5 
6.5 
7.5 
8.5 
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Table 46. TABLE OF AE READINGS FOR TEC LLLA, Fe 


CUMULATIVE 
FREQUENCY DENSITY FREQUENCY CDF value 


-0000 
-0209 
©1331 
- 3178 
- 4608 
-5685 
- 6768 
-7815 
- 8456 
-8982 
-9315 
-9538 
~9643 
-9806 
-9930 
~9985 
-9990 
1.0000 
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FOWUDIADAUAWNH 
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Figure 17. Plots of original and expected AE CDF from AA CDF, LLLA 


- Table 47. SYNTHESIZED-OIL AND USED-OIL TRANSFORMATION, 
LLLA, Fe : 


transformed scale to AE scale 


synthesized-oil used-oil 
transformation transformation 


- 0000 
- 0390 
- 3378 
-6742 
-9114 
-9610 
-9835 
-9895 
-9955 
1.0000 


max diff. -4797 , 
(location) ( 3.30) 
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